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Summary. — Modern network-like systems are usually coupled in such a way 
that failures in one network can affect the entire system. In infrastructures, biology, 
sociology, and economy, systems are interconnected and events taking place in one 
system can propagate to any other coupled system. Recent studies on such coupled 
systems show that the coupling increases their vulnerability to random failure. Prop- 
erties for interdependent networks differ significantly from those of single-network 
systems. In this article, these results are reviewed and the main properties discussed. 



1. Introduction 

The last decade witnessed an intensive study of complex networks [1, 2, 3, 4, 5, 
6] boosted by several real-world data revealing complex structures in the topology of 
their network like, Internet, airport connections, and power grids [7]. Recently, special 
emphasis has been focused on the robustness of such systems to random failures or 
malicious attacks [8, 9, 10, 11, 12, 13, 14]. Most of these works have been focused on 
single, isolated networks where no interaction with other networks is considered, i.e., 
the behavior of the system is independent of any other, coupled with it. Such conditions 
rarely occur in nature nor in technology. Typically, systems are interconnected and events 
taking place in one are likely to affect the others. Only recently [15, 16], the effect of 
coupled networks has been considered, where a failure of one node in a network may lead 
to a cascade of failures in the entire system. In this manuscript we review these results, 
obtained through analytical and numerical approaches, based on percolation principles, 
which are rather surprising. 

In Fig. 1 is a scheme, from Peerenboom et al. [17], showing the interdependence 
of the relevant infrastructures for daily life, namely, oil, transportation, electric power, 
natural gas, water, and telecommunications. Not only all infrastructures depend on the 
electrical-power network, as one would expect, but also electrical power depends on the 
others, i.e., a bidirectional coupling exists between all networks. This strong coupling 
can lead to catastrophic effects when, for some reason, a failure occurs in one of the 
networks. In September 28 th , 2003, Italy was affected by a country-wide blackout [18], 
which was understood due to the coupling between the electrical power and communi- 
cation networks. In Fig. 2 is the map of Italy with the electrical power network on top. 
Each node is a power station and the edges represent the connection between stations. 
Slightly shifted to the top, is a scheme of the communication network that controls the 
power distribution, where the nodes are servers and the edges are links between them. In 
both cases, nodes are positioned based on their real geographical coordinates and com- 
munication servers are connected to their geographically nearest power station. When, 
for some reason, a failure occurs in one power station (red node in Fig. 2. a), the node is 
removed from the network, and consequently four servers are turned off due to the lack of 
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Fig. 1. - Interdependency of infrastructures (After Peerenboom et al. [17]). 



power supply. When these servers go down, three other servers (in green) become inac- 
tive since they are disconnected from the giant communication cluster. Then, a sequence 
of events takes place, in a cascade fashion, where the power stations connected to these 
servers are shut down (see Fig. 2.b) and a set of other power stations (in green) become 
disconnected from the power grid giant component and, therefore, become inactive (see 
Fig. 2.c). This example shows how a fail in a single power station can lead to a cascade 
of events ending in a blackout spanning over more than half of the system. 

Not only in infrastructures one finds interdependent networks. From economy to 
biology there exist many examples of coupled systems. The network of banks is inter- 
dependent to the network of insurance companies, as well as to the network of firms in 
different fields. These interconnections played a major role in the recent financial crisis. 
The human body networks are also interdependent, e.g., the cardio- vascular, the respi- 
ratory, and the nervous systems depend on each other in order to function. Examples 
of interdependent networks can also be found in social sciences. Therefore, the study of 
the properties of coupled networks is a matter of paramount importance in multidisci- 
plinary science. In this article, we review the recent analytical and numerical results on 
their percolation properties. We start by recalling the main features of single networks, 
in Sec. 2. In Sees. 3 and 4 the case of fully and partially interdependent networks are 
discussed. We present final remarks in Sec. 5. 

2. Single Network Robustness 

For more than a decade the critical properties of isolated (single) networks have been 
studied extensively, see e.g., [5, 6]. One relevant question is related with percolation, 



4 



H. E. Stanley 




Fig. 2. - Cartoon of a typical cascade obtained by implementing the described model on the real 
coupled system in Italy. Over the map is the network of the Italian power network and, slightly 
shifted to the top, is the communication network. Every server was considered to be connected 
to the geographically nearest power station. (After Buldyrev et al. [15]) 



i.e., the emergence of a giant cluster when nodes (or links) are sequentially added to the 
network [19, 20, 21, 22, 23]. Due to symmetry reasons, for a single network, the problem 
can also be formulated in the inverse way. Let us consider an initial configuration of a 
network made of nodes and links connecting them. How the fraction of nodes in the giant 
cluster (largest one) is changed when a fraction 1 — p of nodes (or links) is removed? The 
fraction of the giant component is called the order parameter in the language of critical 
phenomena [19, 20]. 

Several models of networks have been proposed. Their description and critical prop- 
erties can be found elsewhere [5, 6]. In this article we focus on two types of model 
networks: a random graph (Erdos-Renyi) [21, 22, 23] and a scale-free network (Barabasi- 
Albert) [24]. The Erdos-Renyi (ER) network is a random graph obtained by randomly 
distributing M links between N nodes, being a statistical ensemble with equal probabil- 
ity for any generated configuration. The scheme in Fig. 3. a is one possible configuration. 
On the other hand, the Barabasi- Albert (BA) is a network which was grown under the 
preferential attachment rule, i.e., at each iteration a new node is added to the network 
and connected to m already existing nodes with a probability of linking to a certain node 
proportional to the actual degree (number of links) of that node. A typical configuration 
obtained with this model is shown in Fig. 3.b. 

These two models of generating networks lead to different topologies and statistical 
properties. For the ER network, since links are distributed in an uncorrelated way, the 
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Fig. 3. - Single networks, a) Classical Erdos-Renyi model and b) Barabasi- Albert model. 



degree distribution is Poissonian, i.e., the frequency of nodes with k links is [21], 



where A is the average degree, A =< k >, of the entire graph. While in the BA network, 
the preferential attachment rule develops correlations in the network and a scale-free 
degree distribution is obtained, which in a general way is given by [24], 



where 7 is the degree exponent and K an upper limit due to the system finite size. 
The power-law degree distribution favors the existence of highly connected nodes when 
compared with the Poisson distribution. This feature is, in fact, responsible for relevant 
differences in the critical properties of networks obtained with these two models [5, 25]. 

To study the percolation properties of a network, a fraction 1-p of nodes are ran- 
domly removed, and the behavior of the giant component is studied. For an ER network, 
a critical fraction of nodes p c can be defined such that, in the thermodynamic limit, the 
fraction of sites in the giant component goes to zero when more than 1 — p c fraction of 
nodes are removed. A transition then occurs from a percolative ordered state, character- 
ized by the existence of a nonzero giant component to a nonpcrcolative one, where the 
size of the giant component is zero. The order parameter of this phase transition is then 
the fraction of sites in the giant cluster, P^, where for p > p c , 



(1) 



P(fc)=exp(-A)- 



(2) 




m < k < K 
otherwise 



(3) 



P 



OO 



(P - Pc) 



and (3 is a critical exponent. The transition is second order and the percolation threshold 
for ER networks is given by p c = 1/ < k > [23] . 
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The power-law nature of the degree distribution in a scale-free graph leads to richer 
percolation properties in this type of networks. In fact, such properties are dependent on 
the value of the degree exponent 7. For 2 < 7 < 3, the giant component only vanish for 
p c = and no percolation transition occurs [26]. However, for values of 7 above 3, alike 
ER a second-order transition is found but with different critical exponents [5, 25]. Yet, 
the network is very robust to random failure which explains, for example, the stability of 
the Internet to random failures and the high longevity of viruses in the Internet, despite 
the large number of anti- virus softwares in the market. 

For both types of networks, when the percolation transition occurs, it is of second- 
order nature, meaning that a smooth decrease of the order parameter with the increasing 
fraction of removed nodes is observed. Besides, this fraction, at the critical point, is 
rather large (p c is low) being a sign of robustness in the system. As discussed below, 
this is not the case, when interdependent systems are considered. Recently, several 
studies have been published, discussing how to change the stochastic rule of percolation 
to obtain an abrupt transition [27, 28, 29, 30, 31, 32] in a single network. When coupled 
interdependent systems are considered the order of the transition becomes naturally of 
first order nature [15, 16]. 

3. Interdependent Networks Robustness 

Despite the technological and fundamental relevance of coupled networks, only re- 
cently they have been considered and their percolation properties have been studied 
[15, 16]. The results of Buldyrcv et al. [15] disclose an emergency of novel percolation 
properties under coupling not predicted from the behavior of single networks. 

To account for the coupling, let us consider two different networks, hereafter referred 
as A and B. Every A-node depends on a B-node, and vice versa, i.e., a bidirectional, one- 
to-one coupling exists such that if node Ai depends on node Bi then node Bi depends 
on node Ai. The dependency is such that coupled nodes are only active if both are 
connected to the giant component of their network. Network A and network B have 
degree distributions PA(k) and Ps(fc) respectively. The dependency links between the 
networks are achieved by randomly connecting {Ai, Bi) pairs of nodes in both networks 
under the constraint of having only one inter-network link per node. 

Percolation properties are studied by randomly removing nodes in the network A, 
mimicking a failure or malicious attack. When a node Ai is removed, its A-links and 
the coupled node Bi are also removed. As discussed above, in the context of the 2003 
blackout in Italy, removing the node Ai can ignite failures in other nodes. All A-nodes 
which become disconnected from the giant cluster through Ai become inactive and arc 
removed together with their correspondent i?-nodes. Analogously, all B-nodes bridged 
to the giant component through node Bi are also removed. The same procedure is, 
recurrently, followed for all removed nodes and their counterparts in the other network 
leading to cascading failures between the two networks. This procedure reveals, as in 
the case of single networks, discussed in Sec. 2, that when a fraction of nodes 1 — p is 
removed, a percolation transition occurs at a certain threshold, p = p c . Only for values 
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Fig. 4. - Fraction of nodes in the giant component (p n /p) after n stages of cascading failures for 
different realizations of two coupled ER networks with the same degree distribution and 128000 
nodes. Initial removal is just below the percolation threshold with p = 2.4554/ < k >= p c . 
(After Buldyrev et al. [15]). 



of p above this threshold a giant mutually connected cluster exists. Below it, the entire 
system becomes completely fragmented. 

For two coupled ER networks the problem can be solved explicitly using generating 
functions [15, 33, 34, 35]. When the two networks have the same degree, i.e., < k >a=< 
k >b = < k >, the value of p c is, 



where / = exp((f - l)/2/), with the root / « 0.28467, giving p c » 2.4554/ < k >. This 
threshold is much larger than the one for single networks, where p c = 1/ < k > (sec 
Sec. 2 for details), revealing a significant increase in vulnerability due to the coupling. 
Moreover, if the fraction of nodes in the giant component (fioo) is analyzed, as a function 
of p, unlike the single network case, where it continuously vanishes when approaching 
Pc a nonzero finite value is obtained at p c . The cascade of failures leads to a first-order 
transition, characterized by a jump in the order parameter (fraction of nodes in the 
mutually connected giant component) at p c . 

The fraction of the giant component, p n /p, after n stages of the cascades for different 
realizations of ER networks with 128000 nodes, nearp c , is shown in Fig. 4. For simplicity, 
the same degree distribution for both networks have been considered. As predicted by 
the theory, after a plateau of many cascading steps, the fraction of the giant component 
suddenly drops to zero. Due to the system finite size, for simulations, the system con- 
verges either to a mutual giant component or to a complete fragmentation of the system. 



(4) 
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Fig. 5. - Scaled distribution of the number of stages in the cascade failures for two Erdos- 
Renyi graphs, with the same degree distribution, at criticality, for different values of N. (After 
Buldyrev et al. [15]). 



At p c , the average number number of stages in the cascade scales with N 1 / 4 (see Fig. 5). 

In Fig. 6 we plot the threshold, p c , and the fraction of nodes in the mutual giant 
component, /x^, for different ratios between the average degrees of the networks, < k >a 
I < k >b- When the average degree is the same for both networks, < k >a=< k >b, as 
discussed above, the threshold is given by eq. (4) and /loo at p c is nonzero, i.e., the coupled 
system is more vulnerable than the single network case and the percolation transition is 
first order. As the ratio between the average degree of the networks decreases, both the 
threshold and the jump at the transition diminish. Therefore, the smaller the ratio the 
more resilient is the system to failures. In the limit where the ratio approach zero, the 
single- network features are recovered, i.e., the transition becomes of second-order nature, 
with p c = 1/ < k >. 

When coupled scale-free networks are considered, a percolation transition, at nonzero 
Pc, is obtained even for values of the degree exponent 2 < 7 < 3. This is in contrast 
to the single network case, where a giant cluster is observed for any positive fraction 
p of nodes (see Sec. 2). Analogously to ER networks, the coupling between scale-free 
networks significantly increases the vulnerability of the system, with a larger p c compared 
to the case of a single network. Since hubs can have a low-degree counterpart node, their 
vulnerability evinces with the coupling. In contrast to single networks, the broader the 
degree distribution the larger is p c , i.e., the smaller the fraction of nodes that needs to 
be removed to fully fragment the system. 

In general, the coupling between networks, increase the vulnerability of the system 
due to the cascade of failures that can be activated by removing a small fraction of nodes. 
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Fig. 6. - For two coupled Erdos-Renyi networks, the threshold p c and the fraction of nodes in 
the mutual giant cluster at the transition, fx^, are plotted as a function of the ratio between 
the average degrees of networks A and B, < k >a / < k >b- 



Findings are summarized in Fig. 7. While for a single network, a second-order percolation 
transition is observed where the order parameter vanishes smoothly at criticality, for 
coupled systems, the transition occurs for larger p c (lower fraction of removed nodes), 
and is rather abrupt, characterized by a discontinuity in the order parameter. In the 
next section, the case of partially dependent networks is reviewed. 




Fig. 7. - The order parameter (fraction of sites in the giant component) as a function of the 
fraction of left nodes in single and coupled networks. For single networks, above the percolation 
threshold a smooth increase of the order parameter is observed, with a critical exponent /3. 
However, for strongly coupled networks, an abrupt transition is observed, characteristic of first- 
order transitions, due to the cascade phenomenon discussed in the text. 
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Fig. 8. - Order parameter P x as a function of the fraction of nodes left p for Erdos-Renyi and 
scale-free network (7 = 2.7) with strong and weak coupling. Both systems contain 5 x 10 4 nodes. 
For both network types, first-order transitions occurs for strong coupling in contrast to second 
order transition in weak coupling. (After Parshani et al. [16]). 



4. Partially Dependent Networks 

Frequently, in real-world systems not all the nodes in one network are interdependent 
on the other network and vice versa, via bidirectional links. Instead, some nodes may 
be autonomous and independent on nodes from the other networks. For example, in the 
communication/power- grid system, a fraction of servers may be protected by emergency 
power supplies which are activated when the local power station is shut down. Parshani 
et al. [16] have studied the behavior of partially interdependent networks under random 
failure and found quantitatively how reducing the coupling improves the robustness of 
the system against random attack and how percolation transition changes from first to 
second order. 

The model introduced in Sec. 3, can now be generalized to account for partially 
coupling between networks. Two coupled networks are then considered, A and B, with 
degree distributions Pa (A:) and Pe(fc), respectively. In network A, a fraction of nodes 
qa depends on nodes from network B. Likewise, in network B, a fraction of nodes qb 
depends on nodes in A. In the limit of qA — q_B = 1 the fully interdependent system, 
discussed above, is recovered. 

Following the procedure described before, 1—p nodes are randomly removed and the 
percolation properties of the system studied. If a removed node has a dependent in the 
other network, this node is also removed. All nodes linked to the correspondent giant 
component solely through the removed nodes are also considered inactive. In Fig. 8 
we show the curves of the fraction of sites belonging to the mutually connected giant 
component, P^, as a function of p. ER and scale- free networks (with 7 = 2.7) have been 
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Fig. 9. - The giant component as a function of the number of cascade failures in two coupled 
Erdos-Renyi networks, with Na = Nb = 8 x 10 j and < k >a~< k >b= 2.5, for two different 
coupling strengths, (a) p = 0.7455, qA = 0.7, and qs = 0.6 (first order), (b) p = 0.605, qA = 0.2, 
and qs = 0.75 (second order). Solid lines correspond to results obtained from theory based on 
generating functions. (After Parshani et al. [16]). 

considered, with strong (qA = qB = Q = 0.8) and weak (q = 0.1) coupling. For both 
systems in the strong coupling case, the robustness of the coupled networks systems is 
similar to that observed in the limit of q = 1 (see Sec. 3). Reducing the coupling leads to 
a second order phase transition similar to single networks (the case of q = 0). Increasing 
the coupling leads to a percolation transition at larger p c and to a change from second 
order, under weak coupling, to first order for strong coupling. 

The giant component as a function of the number of iterations in the cascade of 
failures, close to the transition point, for a strong and weak coupled system is shown 
in Fig. 9. Two coupled ER networks have been considered, with Na = Nb = 8 x 
10 5 and the same average degree of nodes, with strong and weak coupling. In the 
strong coupling regime, a plateau is obtained followed by an abrupt decrease of the order 
parameter, similar to the case q — 1 of the a first-order transition. While, in the weak 
coupling regime, the order parameter smoothly vanish with the number of iterations of 
the cascades. 

Results for partially dependent networks are summarized in the two-parameter phase 
diagram of Fig. 10. In the horizontal axis is the fraction of removed nodes in network 
A, 1 — p, while in the vertical one is the fraction of independent nodes in the same 
network, 1 — qA- The value of qB is chosen to be qs = 1. Two different regimes can be 
identified in the diagram. In the right side of the diagram (below the curve), no finite 
giant component exists in network B at p c . That is, the system is below p c . In the left 
side, a giant component exists in the system. This two different regimes are separated by 
a phase transition line. When one crosses this line, a percolation transition is observed. 
The solid line corresponds to a first-order transition, characterized by a jump in the order 
parameter at the transition point. The dashed line stands for a second-order transition, 
where a continuous change of the order parameter is obtained. For a fully coupled system, 
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1-p (removed nodes in network A) 

Fig. 10. - Diagram for percolation in two coupled networks in the two-parameter space, namely, 
the fraction of independent nodes in one network and the fraction of removed nodes in the same 
network. For weak coupling (large fraction of independent nodes) the transition is continuous 
(dashed line). Below a certain fraction of independent nodes, due to the coupling strength, the 
transition becomes discontinuous (first order). The vulnerability of the system increases with 
increasing in the coupling strength. (After Parshani et al. [16]). 



1 — qa =0, only a small fraction of nodes needs to be removed to observe a fragmentation 
of the whole system in a discontinuous way. As one increases the fraction of independent 
nodes in the system, the fraction of removed nodes at the transition increases, meaning 
that the vulnerability of the system increases. This first-order line of the transition ends 
at a critical point above which the transition is no longer abrupt, being smooth and of 
second-order nature. 

5. Final remarks 

In this review, the recent work by Buldyrev et al. [15] and Parshani et al. [16] on 
the percolation properties of interdependent networks have been revisited. The review is 
based on a Lecture given by S. Havlin in the June 2010 Varcnna School. Modern systems 
tend to be more coupled together. Infrastructures, biology, sociology and economy sys- 
tems are interconnected such that events taking place in one system may propagate and 
influence other coupled networks. Recent studies [15, 16] show that coupling between 
systems increases their vulnerability to random failure. Properties of interdependent net- 
works significantly differ from the ones of a single network. In this article, these results 
are reviewed and the main properties are discussed. When a system of two interdepen- 
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dent networks is considered, where nodes in one network have a bidirectional coupling 
with nodes in the other, the percolation properties are significantly affected. Due to cou- 
pling, not only the transition threshold is increased but also the order of the transition 
changes. 

The presence of interdependency between nodes in different networks, such that if 
one of the nodes is inactive the other can not function as well, leads to catastrophic 
effects when some nodes are removed from the system. A cascade of events is then 
ignited leading to an abrupt decomposition of the mutually connected giant component. 
For two interconnected ER graphs, when nodes are removed randomly, a percolation 
transition is observed. While for a single network the transition is always second order, 
for the coupled system the transition is rather first order and the threshold corresponds 
to much less removed nodes. This increase in vulnerability with the coupling is also 
observed for scale-free networks and, unlike single networks, even for values of the degree 
exponent below three a percolation transition is observed. 

Tuning the fraction of interdependent nodes shifts the percolation threshold. The 
stronger the coupling the lower the fraction of nodes that needs to be removed to fully 
fragment the giant component. Yet, the order of the transition changes from second 
order, in the weak coupling regime, to first order under strong coupling. In the two- 
parameter diagram, of coupling and fraction of removed nodes, there are two transition 
lines, one of first order and the other a second order line that mutually touch in a critical 
point. 

These interesting results raise new questions in the field of complex networks. As a 
natural follow up, it is interesting to understand what happens when different types of 
networks arc coupled, with special focus on real networks. The effect of different types of 
inter-networks connections is also relevant. Besides, understanding how rewiring of the 
system may improve the resilience to failures is of paramount interest. 
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